Experimental implementation of a four-player quantum game 
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Game theory is central to the understanding of competitive interactions arising in many helds, 
from the social and physical sciences to economics. Recently, as the definition of information is 
", generalized to include entangled quantum systems, quantum game theory has emerged as a frame- 

f~>) ■ work for understanding the competitive flow of quantum information. Up till now only two-player 

' quantum games have been demonstrated. Here we report the first experiment that implements 

, a four-player quantum Minority game over tunable four-partite entangled states encoded in the 

polarization of single photons. Experimental application of appropriate quantum player strategies 
give equilibrium payoff values well above those achievable in the classical game. These results are 
in excellent quantitative agreement with our theoretical analysis of the symmetric Pareto optimal 
strategies. Our result demonstrate for the first time how non-trivial equilibria can arise in a com- 
petitive situation involving quantum agents and pave the way for a range of quantum transaction 
| applications. 

PACS numbers: 

INTRODUCTION 

Originally developed for economics, the impact of game theory in this field is now pervasive, and has spread to 
O" 1 many other disciplines as diverse as evolutionary biology [l| , the social sciences Q and international conflict Q . Game 
theory is characterized by the solution concepts of the Nash equilibrium (NE), the result from which no player can 
improve their payoff by a unilateral change in strategy, and the Pareto optimal (PO) outcome, the one from which 
^ ' no player can improve their payoff without another player being worse off. The former can be considered as the 
equilibrium that is best for each player individually, while the latter is generally the best result for the players as a 
group. 

In the search for new applications of quantum information processing based on competitive interactions between 
agents the appropriate language is quantum game theory. Applications can be based on exchanges between several 
agents who share entanglement, in contrast to direct classical communication. The sharing of an entangled resource 
permits competitive von Neumann- type games, with applications such as quantum auctions quantum voting [f|, 
and quantum communication. This is distinct from cooperative games that arise where agents are permitted to 
communicate, either directly or through a third party. In quantum games, entanglement is used as a resource that 
can enhance the payoffs of well known game-theoretic equilibria Q . 
■ While there have been implementations of two-player quantum games with limited strategic spaces 0, HI, nere 
we report for the first time the implementation of a genuine multiplayer quantum game driven by a four particle 
entangled state. Generally, two-player quantum games do not see the enhancement of the pure strategy equilibrium 
payoffs [1, G3 that can arise in multiplayer quantum games. The practical exploration of quantum games allows us 
to learn about the nature of quantum information in a real situation. Figure [T] compares the classical and quantum 
versions of a four-player game. 

We choose to implement a four-player Minority game. The Minority game arises as a simple multi-agent model for 
studying strategic decision making within a grou p of a g ents [ill ]. Its classical version has been used as an iterative 
model of buying and selling in a stockmarket 12, 13, 14 1- In each play, the agents independently select between one 
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of two options, labeled '0' and '1' ('buy' and 'sell'). Those that choose the minority are awarded a payoff of one unit, 
while the others receive no payoff. Players can utilize knowledge of past successful choices to optimize their strategy. 
In the quantum situation we can represent each player's binary choice by the polarization of a pho ton as in Fig. [2] 
Quantum versions of a one-shot Minority game have generated some theoretical interest 

[S EM El El- In this 
paper we report on the first experimental implementation of the quantum Minority game (QMG). 

We begin with a theoretical exploration of the QMG. With the particular experiment in mind, we choose the initial 
state to belong to a continuous set of four-partite entangled states involving a mixture of the GHZ state and products 
of EPR pairs. We calculate the NE and PO strategy profiles as a function of the initial state. Our method is a general 




FIG. 1: Schematic showing the flow of information in a four-player quantum game (left) and a four-player classical game (right). 
In the quantum version the players utilize an entangled state as a resource, however in both versions there is no communication 
between the players. For the particular case of the Minority game the equilibrium payoffs are indicated in the bar graph, with 
those of the quantum case being the values achieved experimentally with our setup. 



one that can be applied to any quantum game that has a similar protocol. Our quantization of the Minority game 
is described as follows and is shown schematically in Fig. [TJ Each of four players is given one qubit from a known 
four-partite entangled state. This state is an element of the subspace spanned by the four-qubit GHZ state and a 
product state of two Bell (or EPR) pairs. The players are permitted to act on their qubit with any local unitary 
operation. The choice of such an operator is the player's strategy. During this stage coherence is maintained and 
no communication between the players is permitted. After the player actions, a referee measures the qubits in the 
computational basis and awards payoffs using the classical payoff scheme. In the dominant protocol of quantum games 
due to Eisert et al. @, [l9[ , an entangling gate is used to produce a GHZ state from an initial state of 1 00 . . . ) . After 
the players actions the inverse operator is applied to the multi-partite state. For the Minority game this last operator 
only has the effect of interchanging between states where the same player (s) win and so can be omitted without 
changing the expected payoffs. Our arrangement is consistent with the generalized quantum game formalisms of Lee 



and Johnson [201 ] and Gutoski and Watrous 2l|, and is particularly suited for an implementation using entangled 
photon states and linear optics quantum logic. 

THEORY 

A four player QMG was first examined by Benjamin and Hayden and later generalized to multiple players flB ] 
and to the consideration of decoherence [l(|. Formally the QMG is played by computing the state 
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(A® B®C®D)p in (A®B® C® D)\ (1) 



where A, B, C, D are the operators representing the strategics of the four players and p m is some four qubit input 
state. The qubits in pn na i are subsequently measured in the computation basis and payoffs are awarded using the 
classical payoff matrix. Work to date has concentrated on the consideration of an initial GHZ state. In this paper we 
instead consider an the initial state that is a superposition of the GHZ state with products of EPR pairs: 



| *(a)> = ^(10000) + |lili» + ^IIZ(|01) + |10))®(|01) + |10» 

= -^{\HHHH) + \VVVV)) (2) 
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fs - UV pulses 




FIG. 2: Setup for the observation of ^(a)). Four photons, emitted in two spatial modes a and c, interfere at a polarizing 
beam splitter (PBS). Prior to the interference the polarization of the photons in mode c is rotated by a half-waveplate (HWP) 
set to an angle 7. Afterwards the photons are split into four output modes a, b, c, d by two beam splitters (BS). Under the 
condition of detecting one photon in each mode the desired state is observed. The player unitary strategies are executed by a 
combination of a quarter-, a half- and a second quarter- waveplate (M). 



where a € [0, 1] is an adjustable parameter. The qubits are encoded in the polarization of single photons propagating 
in well-defined spatial modes. The computational basis states |0) and |1) are represented by the states \ H) i and 
I V) i , denoting the state of a single photon in the spatial mode i with linear horizontal and linear vertical polarization, 
respectively. Most of the time the spatial mode will be evident from the context and hence the subscript be omitted. 

To make allowances for some loss of fidelity in the preparation of this state the initial state will be written as the 
mixed state 



/!*><*! + ^EtfW=o,i I ijkt ) ( ijk£\, (3) 



where / € [0, 1] is a measure of the fidelity of production of the desired initial state. The second term in ([3]) represents 
completely random noise 22|. The players' strategies arc single-qubit unitary operators that can be parametrized in 
the form 

M(6, Pi, fa) - ^ %e -^ gin( /2) e - m cos{9/2) ) , (4) 

where 9 € [0, 7r], (3\, P2 & [— i", t]- In our construction of the QMG only the difference in the phases is relevant to the 
expected payoff so it suffices to use a restricted set of operators where j3 = /3i = — 02- 

In the case where a = 1 it is known that a symmetric NE occurs when all players choose the strategy @ 

,tt 7T -7r 1 / e i7r/s ie~ i7r/8 
•2' 8'~8~^ = V2 V leW8 e 



M(,,T)m iI/8 %; 8 )■ (5) 



Although the value /3i = — P2 — tt/8 is not the unique optimum, it is a focal point [23j that attracts the attention of 
the players since it is the simplest optimum value, and therefore there is no great difficulty in arriving at this NE. 
Given that at most one player of the four can be in the minority, j is the greatest average payoff that can be expected. 
This is realized with the above strategy when the initial state has maximum fidelity. As / — > 0, the payoff reduces 
to |, the optimal payoff in a one-shot classical Minority game, where the the players can do no better than choosing 
betweeen the two options with equal probability. This is as expected since in the absence of entanglement the QMG 
cannot give any advantage over its classical counter part. 
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We can search for a NE in the case of general a as follows. If there exists 0* , (3* such that 



$ D [M{9*,/3*,-(3*f 



> 



d (M(9* , /?* , ~/?T 3 ® M(0, /3, -/3) ) V 0, /3, 



(6) 



where $d(-) denotes the payoff to the fourth player (Debra) for the indicated strategy profile, then M(9*, (3* , — (3*) is 
a symmetric NE strategy. There is no in principle objections to asymmetric NE strategy profiles, where the players 
choose different strategies, however in practice these cannot be reliably achieved in the absence of communication 
between the players since it is otherwise impossible for the players to know which of the different strategies to select. 
Necessary, but not sufficient, conditions for the existence of a symmetric NE are 
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(7a) 
(7b) 



9', 0=I3- 



wherc ($d) is here the payoff on the right hand side of ©■ Inequalities in (|7b[) indicate a local maximum in the payoff 
to Debra, however this may not be a global maximum. An equality in (|7b[) may mean a local maximum, minimum or 
an inflection point in the payoff. We shall now enumerate all the symmetric NE strategies by considering Eqs. (|7all7bl) 
over the range of a G [0, 1]. 

If Alice, Bob and Charles use the strategy M(9, /3, — /3) while Debra plays M(9' , /?', —(3') then 
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sin 29 r 



d/3' 



9,f3'=/3 



,/3'=0 



2a 2 + 2a\/2-2a 2 cos 4/3 



(2a 2 - 2 - 2a V / 2 - 2a 2 cos 4/3 - a 2 cos 2 4/3) sin 2 9 



— sin 4/3 sin 9 
2 



(8) 



( \]2 - 2a 2 + a cos 4/3) sin 2 9 - 2^/2 - 2a 2 



We want to find 9, /3 for which these derivatives are simultaneously zero. Apart from the known NE for a = lwc find 
that the only other symmetric NE occurs for a < \ / 1 when cos 4/3 = 1 and 



cos 9 



2 - 3a 2 



+ 2aV2 - 2a 2 



The expected payoff to each player for this equilibrium is 

, $ , = a(2-3a 2 )(a + V2-2a 2 ) 
4 - 2a 2 + Aay/2 - 2a 2 ' 



(9) 



(10) 



i(3-v / 3). Figure [3] gives the value of 



which reaches a maximum value of (3 + 2\/3)/(18 + 10\/3) ~ 0.183 at a = 
9 and the resulting payoff for this solution. 

We now consider the PO strategy profile. Again we will only consider symmetric strategy profiles. That is, we are 
interested in 9*, f3* for which 



$ [M {9*, 13* ,-13*)® 4 ) > ($ (M{9,(3,-f3) 
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V0,/3, 



(11) 



where $ represents the payoff to any one of the four players for the indicated strategy profile. Suppose all players 
select the strategy M(6>, /3, —(3) for some 9, (3 to be determined. We proceed as before by finding the stationary points 

of the payoff to each player as a function of the parameters 9 and (3. We find that for a > ^/|, where the initial state 
is dominated by the GHZ state, the optimal strategy is M(^, — f )j while for the EPR-dominated region, a < 
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FIG. 3: Left scale, solid lines: The Pareto optimal (-•-) and Nash equilibrium (-•-) payoffs as a function of the initial state 
parameter a. The Pareto optimal payoff curve is labeled by I or II for strategy M(f , 0, 0) or M(|-, respectively. Right 

scale, dashed line: The value of 9 given by (O that, along with j3 = 0, gives a symmetric Nash equilibrium. 



the optimal strategy is M(j, 0,0). At a = y | all components in the initial state are equally weighted and both 
strategies yield the same results. The payoffs for the two regions are 



>i = i + ^a(2V2-2a 2 -a) 



a < 



a > 



(12) 
(13) 



Figure [3] shows the payoffs for these cases for a fidelity of / = 1 . 

There has been some recent interest in the correspondence between equilibria in quantum game theory and the 
violation of Bell inequalities 2J, |25[. In our case we note that the curve for the symmetric PO payoff is the same as 
that for the maximal violation of the Mermin-Ardehali-Belinski-Klyshko (MABK) inequality [26| . 



EXPERIMENT 



State observation: 



The states are obtained with a new linear optics network which enables the observation of a whole family of states 
in a single setup by the tuning of one experimental parameter [2^ | . The setup relies on the interference of the second 
order emission of type II non-collincar spontaneous parametric down conversion (SPDC) and is depicted in Fig. [5] 
The down conversion emission yields four photons, two horizontally and two vertically polarized, in two spatial modes 
a and c. The photons are overlapped on a polarizing beam splitter (PBS) and afterwards symmetrically split up by 
two polarization independent beam splitters (BS) into the four spatial modes {a, b, c, d}. Prior to the interference 
at the PBS the polarization of the photons in mode c is rotated by a half-wavcplatc (HWP). Under the condition 
of detecting one photon in each spatial mode the desired state is observed. The weighting coefficient a is thereby 
determined by the orientation of the principal axis 7 of the HWP according to 



2v / 2sin 2 (27) 



1/5 - 4 cos(4 7) + 3 cos(8 7) 



(14) 



with 7 € [(),£]. 
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Implementation of the game: 



The implementation of the four-player QMG consists of acting with the strategy operator on each qubit and 
afterwards measuring the resulting output state in different bases. The unitary transformation corresponding to the 
players' choice of strategy is realized by a series of quarter-, half- and quarter- waveplate (see Fig. [2]). In order to 
play strategy I and to act with M : = M(f , f , — f ) the angles of the waveplates are chosen as {— f , ff , 0}, and for 
strategy II and M u = M(f ,0,0) as {§ , §}. 

Results: 

We start the measurement with a = 1 as in this case a NE solution is expected. The expected state after the 
application of strategy I, which is here the optimal one, is of the form 

{M® A )\GHZ) = l -=(\HHHV) + \HHVH) + \HVHH) + \VHHH) 

2v 2 ^ 

-\VVVH) - \VVHV) - \VHVV) - \HVVV\ 

= -4=(| RRRR } — | LLLL }), (15) 
v 2 

with \R/L) — -j=(\H) ±i\V)) being the right and left circular polarization states. The transformed state is also 

of GHZ- type, and thus the fidelity F = (GH Z\M? m p%^M® A \GH Z) of the experimental state p^ 1 equals the 
average expectation value of the GHZ stabilizer operators [28( . A measurement of the respective correlations is hence 
sufficient to evaluate the state fidelity. In our case, this requires 9 measurement settings and we obtain a value of 
F = 0.746 ± 0.019. For comparison, the fidelity of the untransformed initial GHZ state obtained with our setup is 
F = 0.745 ± 0.022. 

The payoff awarded to each player can be evaluated from the correlation measurement in the computational basis, 
o z ® cr z <g> <r z ® a z . Averaged over all four players the payoff obtained for a = 1 is ($i) Q= i = 0.206 ± 0.009 which is 
well above the classical limit of §. 

o 

As was shown earlier, the maximal achievable payoff depends on a and, moreover, there is an interesting change 
in the Pareto optimal strategy at a = y2/3. In order to test this experimentally we chose to perform measurements 

for other distinguished states, ^(O)), |^(\/J)}> an d l^(y§)}- The results obtained are summarized in Fig. 0] 
which gives the average PO payoffs for the four values of a for strategies I and II, along with best fit curves and 
theoretical curves for perfect fidelity. As can be seen in the boxes at some example points, the payoffs differ slightly 
for each player but are generally comparable within typical measurement error of around 9-12%. The only exception 
occurs for player C and player A for a = y/2/11 and \/2/3, respectively. The cause of this could not be rigorously 
identified. The average payoffs follow the expected dependence for both strategies, once imperfect state quality is 
taken into account. To allow for loss in the states' fidelity the data in Fig. [4] is fitted assuming a mixed input state 
of the form (J3j) . Although the assumptions of an admixture of white noise and constant state quality are only an 
approximations, the value of / = 0.71 ± 0.03 obtained from the fit is in good agreement with the measured GHZ 
fidelity, where F = (1 + 15/)/16 w 0.73. Let us discuss the results for each measured point in more detail. 

For a = a product of two Bell states is expected. As this state is not four-qubit entangled it should yield 
at best the classical payoff for strategy II. This is nicely reproduced in the experiment with an average payoff of 
($h)q=o = 0.125 ± 0.006. If the players chose to play strategy I zero payoff is expected for ideal, pure input states. 
However, for an increasing mixedness of the input states the payoff approaches the classical limit, with equality 
for / — ► 0. This fact leads to a non-zero value for the experimentally measured average payoff for strategy I, 
($i) a =o = 0.033 ±0.003. 

Similar behavior is obtained for a = y/2/11, where the measured payoffs for strategy II, ($ n ) _ /jjtt = 0.156±0.007, 



2/11 

and strategy I, (^i) Q ,_V^7 1 J = 0.073 ± 0.004, are lower and higher than expected, respectively. Never the less, the 
experimentally reached state quality is high enough to ensure for the proper strategy, a payoff which exceeds the one 
maximally achievable in the equivalent classical game. 

As mentioned before, a = \/2/3 is special as both strategies lead to the same payoff. It is the point about which 
the players have to switch between the different strategies. The corresponding state, 1^(^/2/3) ) = (^4) is well 
known from literature as it can be directly obtained from spdc m m, Em and has several interesting applications 
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4 Alice 
■ Bob 

▼ Charles 
♦ Debra 



FIG. 4: Measured payoff ($i,n) averaged over all four players as a function of a for strategy I (-•-) and strategy II (-•-). The 
data is fitted assuming a mixed input state of the form / | ^(a) ) ( ty(a) | +(1 — /)/l 6 I® 4 [see ([3])] . Dashed lines correspond 
to the ideal case / = I . The boxes show the individual values for the four players for some sample points. Typical errors for 
individual measurements are 9-12 %. The maximum equilibrium payoff in a classical game is h. 



in quantum information (see, for example, Rcfs. 31, 32|). The point's feature of being a quantum fulcrum is nicely 
reproduced in the experiment. Within the measurement errors the average payoffs, (^i) a —^2/3 = 0.141 ± 0.009 and 
($n) Q= r^ji = 0.148 ± 0.008 are the same for strategy I and II (see Fig. H|). 

Finally, the values obtained in the GHZ case fit well in the dependence prescribed by the previous points. Like for 
the other states, due to imperfect state quality the average payoff is slightly lower (higher) than the ideal value of \ 
(i) for strategy I (II). 

In summary, we can state that for all values of a the players are awarded payoffs above the classical NE value if 
they choose the appropriate strategy. The values are consistent with a fidelity of 0.73 for the initial production of 
four-partite entangled state. 

In our realization of the Minority game we do not use an unentangling gate. Thus a measurement in the com- 
putational basis alone does not prove that the higher than classical payoff values have their seeds in the four-qubit 
entanglement of | fy(a) ). In principle they could be caused by an admixture of the separable state 

1 
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+ | VVVH ) ( VVVH | + permutations J , (16) 

which yields a maximal "payoff" of j when measured in the computational basis. However, measured in other bases, 
the state p sep will not give a payoff above the classical limit. 

In contrast, the state | 4" (a) ) has the extraordinary property that it exhibits the same term structure in the bases 
a z (g) cr z (g) a z <£> o z and a x <£> a x g) <r x <g> a x when transformed by M® 4 and in the bases a z ® a z <£> a z <g> a z and 
(jy®a v ®a y ® (J y when transformed by M,f 4 . Consequently, if the payoff is evaluated analogously in these bases, the 
same dependence on a is expected. In order to prove this we have performed the same measurements as before in the 
bases a x <£> a x ® <j x ® a x and a y <g> a y <g> a y ® a y . The result is shown in Fig. [5] 

For each basis and appropriate strategy we find very similar curves to those for the computational basis. We applied 
the same fitting procedure as before. The resulting values for / are slightly different for both bases (f x = 0.736± 0.019 
and f y — 0.706±0.053) but comparable with the one found for the computational basis. The small asymmetry between 
the bases indicates that, contrary to our assumption, the experimental noise is not purely white noise. 



CONCLUSIONS 



We have studied the four-player quantum Minority game where the initial state is drawn from a continuous set 
of four-partite entangled states consisting of a superposition of the GHZ state and a product of EPR pairs. There 
is a well known Nash equilibrium when the initial state is a GHZ state. For other initial states in our set there 
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FIG. 5: Measured payoff (Si,n) averaged over all four players as a function of a in the basis a x ® a x ® a x ® o x for strategy 
I (-•-) and in the basis a y <g> a y ® a y <g> a y for strategy II (-•-) The data is fitted assuming a mixed input state of the form 
/ |*(a))(*(a) | +(1 - /)/16l® 4 [see ©]. Dashed lines correspond to the ideal case / = 1. The maximum average equillibrium 
payoff in a classical game is | . 

are only symmetric Nash equilibria when the initial state is in the EPR-dominated region, though the payoff for 
this equilibrium is only sometimes higher than that achievable classically. There are two symmetric Pareto optimal 
strategies, one for the EPR- and one for the GHZ-dominated initial state. In both cases the payoff is equal to the 
classical optimal payoff of | plus a value proportional to the fidelity to which the initial entanglement is produced. 

An experimental implementation of this game is carried out using four-photon entangled states generated from 
spontaneous parametric down conversion. Results for four different initial states were obtained. The results are 
consistent with the theory for fidelities in the range 0.71-0.73 depending on the initial state. For these fidelities the 
average payoffs obtained are above those that can be obtained in a classical Minority game (with an unentanglcd 
initial state) thus demonstrating the usefulness of entanglement. This is the first implementation of a multiplayer 
quantum game. 

The study of quantum games is interesting in general as it provides another point of view to exploit pre-existing 
classical frameworks as a base for finding new ways of understanding and using entanglement in quantum systems. 
While game theory is the mathematical language of competitive (classical) interactions, quantum game theory is 
the natural extension to consider competitive situations in quantum information settings. For example, eavesdrop- 
ping in quantum communication (see, for example, Refs. [33l . l34l . HB)]) and optimal cloning (36| can be conceived 
as strategic games between two or more players. The particular game discussed here represents a different means of 
studying the entanglement structure of the used input states. As shown elsewhere [26|, there even exists an interesting 
correspondence between the equilibria in the Minority game and the violation of Bell inequalities. 



METHODS 



For operation of the SPDC a /3-Barium borate (BBO) crystal is pumped by UV pulses having a central wavelength 
of 390 nm and an average power of 600 mW obtained from a frequency-doubled ThSapphire oscillator (pulse length 
is 130 fs). Another HWP and a 1 mm thick BBO crystal compensate walk-off effects. The spatial modes a and c 
arc defined by coupling the emitted photons in single mode fibres. Spectral filtering of each mode is achieved by 
interference filters centered around the degenerate wavelength of 780 nm with 3 nm full width at half maximum. 
The optical path lengths in modes a and c are aligned by a Hong-Ou-Mandcl (HOM) interference measurement 
37| to ensure temporal mode matching. Pinholes serve as mode filters to enhance the spatial indistinguishability 
of the photons at the PBS. Phases between horizontal and vertical polarization are set by pairs of perpendicularly 
oriented birefringent Yttrium- Vanadate (YVO4) crystals. Polarization analysis is performed in all of the four outputs 
by half- and quarter- waveplates followed by a PBS. The photons are detected by eight Silicon avalanche photo diodes 
(Si-APD) whose signals are fed into a multichannel coincidence unit which allows us to simultaneously register any 
possible coincidence detection between the inputs. The rates for each of the 16 characteristic fourfold coincidences 
are corrected for the difference in the efficiencies of the detectors. The errors on all quantities are deduced from 
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Poissonian counting statistics of the raw detection events and independently determined efficiencies. 
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